LONG-TIME ASYMPTOTIC SOLUTIONS OF CONVEX 
HAMILTON- J ACOBI EQUATIONS WITH NEUMANN TYPE 
BOUNDARY CONDITIONS 



HITOSHI ISHII 

Abstract. We study the long-time asymptotic behavior of solutions u of the Hamilton- 
Jacobi equation u t {x,t) + H(x, Du{x,t)) = in x (0, oo), where Q is a bounded open 
subset of K™, with Hamiltonian H = H(x,p) being convex and coercive in p, and establish 
the uniform convergence of u to an asymptotic solution as t —> oo. 



1. Introduction 

We study the long-time behavior of solutions of the initial-boundary (value) problem for 
the Hamilton- Jacobi equation 

(1.1) u t (x,t) + H(x,Du(x,t)) = infix(0, oo), 

where u = u(x,t) represents the unknown function on Q x (0, oo), Q is a bounded domain 
(i.e., open connected subset) of R n , u t := du/dt, Du := (du/dxi, du/dx n ) and H = 
H(x, p) is the so-called Hamiltonian, which is a given continuous function on O x M" assumed 
to be convex in p. We are concerned with the Neumann type boundary condition 

(1.2) Dju(x, t) = g{x) on dVt x (0, oo), 

where g is a given continuous function on dQ, D 7 u(x,t) denotes the derivative of u in the 
direction of the vector j(x), i.e., D^u(x,t) := 7(2?) ■ Du(x,t), and 7 is a given continuous 
vector field on dQ oblique to dQ. The initial condition is given by a continuous function uq 
on 0. That is, 

(1.3) u(x,0) — u (x) for x E Q. 

In addition to the continuity of H, g, 7 and u and the boundedness of Q, we make the 
following assumptions. 

(Al) H is a convex Hamiltonian, i.e., for each igQ the function H(x, •) is convex on R". 
(A2) H is coercive. That is, lim H(x,p) = 00 for all x E fl. 

\p\— too 

(A3) Q is a C 1 domain. 

(A4) 7 is oblique to dQ. That is, for any x G dQ, if u(x) denotes the outer unit normal 
vector at x, then v{x) ■ j(x) > 0. 
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According to [To"| Theorem 5.1] (see also [T5| Theorem 12]), we have the following existence 
and uniqueness theorem. 

Theorem 1.1. Under the above assumptions, there exists a unique solution u G C(Cl x 

[o, oo)) of (E2P-(E1- 

The stationary problem associated with (jTTTJ)— (JTT3J) is the so-called ergodic problem or 
additive eigenvalue problem, that is, the problem of finding a pair of a constant c G R and 
a function w6C (f2) such that w is a solution of 

{H (x, Dw(x)) = c in Q, 
D 7 w(x) = g(x) on <9f2. 

Existence results for the ergodic problem (jl.4p go back to [TBI Section VII]. According to 
[T5l Theorem 6.1] or [T8l Theorem 14], we have 

Proposition 1.2. There exists a unique constant c G M suc/i i/iai ^ as a solution 

w G Lip (H). 

The unique constant c given by the above proposition is called the critical value and is 
given as the minimum value of a G M. for which problem (11.41) . with c replaced by a, has a 
subsolution. A general useful remark here is this: under condition (A2), every subsolution 
w of (II .4|) . with any given constant c, is Lipschitz continuous on 0. 

In the above two propositions, assumption (Al) is superfluous to obtain the stated con- 
clusions, and we do not seek for optimal hypotheses for such conclusions. In fact, this work 
is a continuation of [15] . where the author [15] has studied (II .4p as well as (ll.ip - (jl.3p in the 
view point of weak KAM theory under assumptions (Al)-(A4). 

The notion of solution of (11.11) and (11.21) or (ll.4p adopted here is that of viscosity solution 
and we refer the reader to [31 [TJ [7] for a general account of viscosity solutions theory. 

We set 

Q = {(x,p) eQxR" : H(x,p) = c}, 

S = {(x,£) eOxl" : there exists p G R n such that (x,p) G Q and ^ G D%H(x,p)}, 

where c is the critical value. 

We now introduce another assumption on H and we assume in our main theorem that 
either of the following (A5)+ or (A5)_ holds: 

(A5)± There exists a modulus uj satisfying uj{r) > for r > such that if (x, p) G Q, 
£ G D^H(x, p) and p' G M n , then 

H(x, p + p')>i-(p + p')+ u((£ ■ p)±). 

In the above and in what follows, the term "modulus" is used to indicate a continuous, 
nondecreasing function u on [0, oo) such that u(0) = 0, and we use the notation: r + = 
max{r, , 0} and r_ = min{r, 0} for r G M. 

We are now in position to state our main result. 

Theorem 1.3. Under the above hypotheses, there exists a solution w G Lip (f2) of ( | l.J$ such 
that u(x,t) + ct converges to w(x) uniformly for x G Cl as t — > oo. 
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The above theorem states that the solution u(x,t) of (jl.ip - (jl.3p "converges" to an "as- 
ymptotic solution" w(x) — ct of (II. ip . (II .2p uniformly on Q as t — > oo. 

The study of the long-time asymptotic behavior of solutions of Hamilton- Jacobi equations 
(II. ip has a long history, which goes back to pjjl El E| , an d h has received an intense interest 
in recent years. For some recent developments, we refer to [H [211 El 1221 El El [HI [Til 
[T2l [TBI E21 12D]. These literatures have established results similar to the above theorem in 
the case when Q is a compact manifold without boundary, typically an n-dimensional flat 
torus ([HI Ell El [221 IE]), or in the case when Q is the whole n-dimensional Euclidean space 
under an appropriate behavior of solutions at infinity ([51 QUI HH [UJ [121 E]), or in the case 
of the state-constraints or the Dirichlet boundary conditions ( [22l El [20] ) • Concerning the 
Neumann boundary conditions, Theorem 1 1.3 1 is one of first, general results on the convergence 
of solutions of (11.11) . (11.21) to asymptotic solutions. In this regard, the author recently learned 
that G. Barles and H. Mitake ([!]) had obtained convergence results similar to the above 
theorem. They took a PDE approach similar to the one in [6], which is fairly different from 
ours. They do not assume the convexity of H although our convergence result under (A5)_ 
seems to be out of their scope. 

Henceforth, by replacing H by H — c if necessary, we normalize that c = 0. Thus, the 
problem 



has a solution. The conclusion of Theorem 11.31 is now stated as the uniform convergence on 
Q of the solution u(x,t) of (ll.ip - (ll.3p to a solution w(x) of (II. 5p as t — > oo. 

In the next section we establishes a theorem which adapts [14, Proposition 2.4] to ac- 
commodate the Neumann type boundary condition. In Section 3, we prove our main 
result, Theorem 11.31 In Section 4, we give formulas for asymptotic solutions similar to 
[SI El EH (HI El El E], which are now standard observations. 



We write B r for the open ball : \x\ < r}, with r > 0, and e n for the unit vector 

(0, 0, 1) E R n . Let / = [0, T], with < T < oo. 

In this section we will be devoted to proving the following theorem. 

Theorem 2.1. Let u E C(f2) be a subsolution of U.5\) . Let 7] E AC(J, IR n ) be such that 
r)(t) E Cl fort E I. Setlg = {t E I : f]{t) E dQ}. Then there exists a function p E L°°(I, R n ) 



(1.5) 




2. An existence result 



such that 



(2.1) 

(2.2) 
(2.3) 



— u o T)(t) = p(t) ■ f)(t) a.e. t E I, 

(JLv 

H(rj(t), p{t)) < a.e. t E /, 

l(v(t))-p(t)<g(v(t)) a.e. tel g . 
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Lemma 2.2. Let U be an open subset ofM. n , <p G Lip (U) and 77 G AC(J, M n ). Assume that 
r)(t) G £/ /or a// 1 & I. Then there exists a function q G L°°(I, IR n ) swc/i t/iat 

q(t) G d c u(r)(t)) a.e. t G /, 

— li o 7/(t) = g(t) ■ ?)(t) a.e. t G /. 

0.6 

i/ere 9c«(x) stands for the Clarke differential of u at x, which is defined as 

dcu(x) = O Du(x;r), 

r>0 

where Du(x; r) denotes the closed convex hull of 

{Du(y) : y G IR n , \y — x\ < r,u is differentiable at y}. 

In what follows, given a vector w 6 I" we denote by the symbol w* the function given 
by x t— > w ■ x. Typically we write {e* < 0} for the set {x G M. n : e n ■ x < 0}. Let <p be a 
function defined on a subset V of K n . For x G V, we denote by Dy<f)(x) the super differential 
of at x, i.e., the set of points pGR" such that 

<fi(y) < + £> " (y — x ) + °(\y — x \) as y E V and y — > x. 
When V is a neighborhood of x, we write just _D + 0(o:) for Dy<p(x). 

Lemma 2.3. Lei r > and u G Lip (B r D {e* < 0}). Lei L > be a Lipschitz constant 
of v. Let 7j G M™, with i = 1,2, and e > 0, and assume that 7, • e n > /or z = 1,2 and 
iTi — 72 1 < e/L. Let a G K and assume that 

min{|g| - L, 71 • g - a} < for all q G ^ r n{ e *<o} w ( )- 
Let p G -D^ n r e » <0 }W(0) &e swc/i that 71 • p < a. T/ien we nave 72 • p < a + e. 
Proof. We set P = D^ n ^ et<0 yv(0) and note that 
(2.4) min{|g| - L, 71 ■ q - a} < for all g G P. 

Note as well that P and P are is convex. 

We may assume that v is defined and Lipschitz continuous on B r D {e* < 0}. Fix any 
p G -D^ n | e » <0 |f (0), and choose a function G C l (B r n {e* < 0}) such that -D</>(0) = p and 
that v — (j) attains a strict maximum at the origin. We may assume by adding a constant to 
that - 0)(O) = 

For any < 5 < r, we set 

Q s = {t e R : _ max (v - - te*) > 0}, 
s 5 n{e*<0} 

i« = inf 65. 

It is obvious that (L + \p\, 00) C ©5 C (0, 00) and that if < 5± < 62 < r, then C 0<5 2 . 
Therefore, if < o\ < 5 2 < r, then L + |p| > t Sl > tg 2 > 0. We set 

t = lim t s , 

and observe that 

t = supt«5 G [0, L + |p| ] . 

<5>0 
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We note that if p > 0, then 

(2.5) _ max (v-<p-(t + p)e* n ) > for < 5 < r. 

^n{ e *<o} 

Fix any p > 0, and for /3 > we set 

$s(x) = v(x) - <j>(x) - (t + 2/i)e n • x - (3(e n ■ x) 2 for ieB r n {e* < 0}. 
Let X/3 G -B r fl {e* < 0} be a maximum point of §p. Since $p(xp) > $s(0) = 0, we have 

0(e n ■ xp) 2 < v(xp) - <t>(xp) - (t + 2/i)e n • xp 
from which we see that Xp ■ e n — > as (3 — > oo. Moreover, we deduce that 

liminf(w — <f>)(xp) > 0, 

P— >oo 

from which we conclude that Xp — > as j3 — > oo. 
Observe that if —fi/P < e n ■ x < 0, then 

-/xe n • x - /3(e n • x) 2 = \e n ■ x\(fi - (3\e n ■ x\) > 0. 

From this and (12. 5p we see that $p(xp) = maxg rn | e » <0 | $^ > 0. In particular, we have 
e n ■ xp > 0. Thus, by choosing j3 > large enough, we may assume that xp G B r fl {e* < 0}, 
and consequently we have 

G D + $p(xp) = D + v(xp) - D(j)(xp) - (t + 2/i)e n - 2(3(e n ■ xp)e n . 

Thus, if (3 is large enough, then we have 

(2.6) W(xp) + (to + 2^)e n + 2/3(e n • xp)e n \ < L. 

Next, note that there is a constant p = G (0, r) such that to — p < t p , that is, 

(2.7) _ max (v - (f> - (t - p)e* n ) = 0. 

B p n{e*<0} 

By choosing (3 large enough, we may assume that xp G B p . Then we have 

v(xp) - <p(xp) - (to - p)e n ■ xp < < ®p(xp), 

and therefore 

(3(e n ■ xp) 2 < -3pe n ■ xp = 3p\e n ■ xp\, 

which yields 

(2.8) (3\e n -xp\ <3p. 

Due to (12.71) . the function \1/ := v — <p — (to — p)e* n attains a maximum at the origin over 
Bp fl {e* < 0}, and hence we have 

e ^n{e;<o} f (°) = P ' - ~ »)en. 

That is, we have 

(2.9) p + (t - p)e n G P. 

Sending /3 — y oo first and then /i — > and using (I2.8p . we obtain from (12. 6p 

\p + t e n \ < L. 

Also, from (12.91) we see that 

p + t e n G P. 
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We set A = {t G [0, t ] : \p + te n \ < L} and B = {t G [0, t ] : 7i • (p + te n ) < a}. By 
the convexity of P, since p, p + t e n G P, we see that p + te n G P for t G [0, to]- in view 
of f)2.4p . we have [0, to] = AU B. Since A and B is closed sets, setting r = minP, we have 
t E Ar\ B . Hence, we get 

72 -P <l2 ■ (p + re n ) < 7i • (p + re n ) + (72 - 7i||p + re n | 

< a + L\<y 2 — Til < a + £, 

which completes the proof. □ 

Lemma 2.4. Let 7 G C°°(M n ) and G C°°(R n ) sate/y 

inf e n • 7(x) > and sup (|7(x)| + |g(x)|) < 00. 

Then there exists a function ip G C°°(R re ) such that 

7(2) • Dip{x) = g(x) for x G R™, 
The above assertion is well-known, but for completeness we give a proof. 

Proof. The idea is to solve the initial value problem for the linear PDE 

j(x) ■ Dtp(x) = g(x) in R™, 
ip(x) =0 if e n ■ x = 0. 

For (x,t) 6K"xR let denote the (unique) solution of the initial value problem for 

ODE 

$ t (x, t) = 7($(x, t)) for t G R, 
0) = x, 

where <3> f := d$/dt. By the standard ODE theory we see that <3> G C°°(IR n+1 ). Moreover, 
since 

< inf e n ■ 7 < e n ■ j($(x, t)) = e n ■ <3> f (x, t) < sup (7! < 00, 

R™ Jgn, 

we see that for each x G R n , there exists a unique r(x) G R such that e n ■ r(a;)) = 0. 
Then the implicit function theorem guarantees that r G C (X> (M n ). 
We define ^ G C°°(R n ) by setting 

^(x) = - / ( } 9 m x ,t))dt. 



(2.10) 



It is obvious that ip(x) = if e n ■ x = 0. For rglwe have 

/•r r T { x ) 

iP(x) = - / g($(x,t))dt- / 0($(x,t))dt 



*t(x)— r 

<?($(x,t))dt- / 0(<f($(x, r), t))dt 



5f($(x,t))dt + ^($(x, r)). 

Differentiating the above by r and setting r = 0, we get 

= —g(x) + j(x) ■ Dijj{x). 



(2.11) 
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Thus the function ip is a solution of (I2.10p . which completes the proof. □ 

In the next lemma, we assume that the vector field 7 is of class C 1 . 

Lemma 2.5. Let r > 0, G G C(B r x R n , R) and 7 G C 1 (B r , R n ). Assume that G satisfies 
(A2), with Q replaced by B r , and that e n ■■y(x) > for all x G B r . Let v G C(B r n {e* < 0}) 
and e > 0, and assume that v is a subsolution of 

G(x, Dv) =0 in B r n K < 0}, 

D^v(x) = —e on B r fl {e* = 0}. 

Then there exists a function w G Lip (B r / 2 fl {e* < 5}) , with 5 > 0, such that 

\v(x) — w(x)\ < e for x G B r / 2 fl {e* < 0}, 

and <f> is both a subsolution of 

G(x, Dw(x)) = e in B r/2 H {e* < 5} 

and of 

7(x) • Dw(x) = e in B r / 2 H {|e*| < 5}. 
We remark that, by definition, v is a subsolution of (12.111) if and only if 
G(x,p) < for p G _D + w(x) and x E B r f] {e* < 0}, 

G(x,p) A (7(2) ■ p + e) < tor p e D+ rn{ef<0} v(x) and x G B r n {e* = 0}. 

In order to prove the above lemma we need the following lemma. 

Lemma 2.6. T/jere ezisis a function ( G C°°(R™ x R n ), where R™ := IT" 1 x (0, 00) = 
{e* > 0}, snc/i £/ia£ 

C(f , te) = t 2 C(^, 2) for (£, z, t) G R™ x ]R n x R, 

C(£,*)>0 /or(e, 2 )6r + x(l"\{0}), 

£ ■ ^C(£, 2) = (en • 0(e n • ^) for (£, z) G R™ x R". 

We refer the reader to [151 Lemma 2.3] for a proof of the above lemma. For the proof of 
Lemma [2. 5 1 we follow that of [151 Lemma 2.5]. 

Proof of Lemma \2. 51 In view of (A2) we may choose a constant L > so that 

{G(x, •) < 0} C B L for x G B r . 

It is easily seen that v is Lipschitz continuous on B r fl {e* < 0}, with L as its Lipschitz 
constant. Let ug be the modulus of continuity of the function G on B r x 

Let £ G C°°(R" x R n ) be the function given by Lemma \2. 61 We note by the homogeneity 
of the functions •) that 

Co" 1 ^! 2 < t(Z,z) < C \z\ 2 , \DtC(Z,z)\ < C \z\ 2 , \D x £(Z,z)\ < C \z\ 

for all (£, 2) G R" x R n and for some constant 1 < C < 00. We set ^(x, y) = C(l( x ), x — y) 
and note that 

D x ip(x, y) = (Dj(x)) t D^C(j(x), x - y) + D z Q(i(x), x-y), 
D y tfj(x, y) = - D z C(j(x), x - y), 
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where A T denotes the transposed matrix of the matrix A. From these we get 
(2.12) \D x jP(x, y) + D y ^(x, y)\ = \ (Dj(x)f 'D^(x), x - y) \ < QA \x - y | 2 

where C\ > is a bound of \D^(x)\ over x G B r . 

For < 5 < 1 we define the sup-convolution v s G C(B r ) by 

= _max ( — -ij)(x, y)) . 



y eB r n{e*<o} V 

It is well-known and easy to see that — > t> (x) uniformly on B r fl {e* < 0} as 8 — > 
and that v s is Lipschitz continuous on B r . 

Henceforth we fix any x G B r / 2 fl {e* < 5 2 }, and choose a maximizer y G 5 r fl{e* < 0} 
of the above formula, so that we have 

v s ( x ) = v (y) - -i/;(x, y). 

We collect here some estimates based on this choice of x, y. Let x denote the projection of 
x onto the half space {e* < 0}. That is, x = x — (e n ■ x)e n if e n ■ x > and x = x otherwise. 
Noting that x G B r / 2 fl {e* < 0} and \x — x\ < 5, we get 

v 5 (x) > v(x) — ci/j(x, x), 



and moreover 

-ip(x,y) =v{y) — v 5 (x) < v(y) — v(x) + -zif)(x, x) 



< L\y -x\+ olx ~ yl < L\x -y\ + (L + C )5. 
d 

Since ip(x, y) > C$ l \x — y\ 2 , we get 

\x - y\ 2 < C L5\x -y\ + C (L + C )5 2 , 
from which we deduce that 

(2.13) \x-y\<C 2 5, 
where 

n C L + v /(C , L)2 + 4C , o(Co + L) 
2 

We note from (T27T2T) that 

(2.14) ID^^^ + D^y)! <C 3 5 2 , 
where C3 := CoCiC|. By Lemma 12761 we get 

(2.15) 7(x) • D y tp(x,y) = -e n -~/(x) e n -(x - y). 
Also, we get 

(2.16) \D y t/j(x,y)\<C \x-y\<C 4 S, 
where C 4 := C C 2 - 

With x and y fixed as above, we show that if 5 > is sufficiently small, then 

(2.17) G(x, p) < e for p G £>V(x). 
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We choose a constant 5\ G (0, 1) so that C 2 b\ < r/2 and assume in what follows that 
< 5 < Si. By (I2.13p . we have \x — y\ < r/2. Hence, we have y G B r . 

Fix any p G D + v(x) and choose a function </> G C 1 {B r PI {e n < 0}) so that v — <p attains a 
maximum at x. 

We separate the argument into two cases. We first argue the case when e n ■ y < 0. By a 
simple calculus, we have 

-D y i/;(x, y) G D + v(y) and -D x ip(x, y) + DMx) = 0. 
o d 

Hence, by assumption, we have 

> G(y, -D y i/;(x,y)j > G(x, p) - u G (\x - y\) - uj G ^-\D x ip(x,y) + D y i/;(x,y)\) 

>G(x, p)-u G (C 2 6)-u G (C 3 5). 

We choose a constant 5 2 G (0, 1) so that oj g (C 2 5 2 ) + u G (C 3 5 2 ) < £■ Then, assuming that 
< 5 < 5\ A #2, we have G(x, p) < e. 

Next, we turn to the case where e n ■ y = 0. Then we have 

D(f)(x) — —-D x i/;(x,y) G D + v s {x) and ~D y i/;(x,y) e D+ rn{< < 0} v(y). 

Using f )2.15p . we compute 

7(x) • D y tp(x,y) = -e n -7(x) e n -(x - y) = -e n -j(x) e n -x > -C 5 5 2 , 
where C5 > is a bound of sup Br |7|. Since \D y ^(x, y)\/S < C4 by (I2.16p . we get 

7(2/) • ^D y ip(x, y) = 7(2) • ^D y ip(x, y) + (j(y) - 7(a)) ■ ^D v 4j(x, y) 

> - C 5 5 - C 4 Uj(\x - y\) > -C 5 5 - C^^S), 

where cj 7 denotes the modulus of continuity of 7. We select a 5 3 > so that C^u^^C^) + 
C 5 5 3 < e, and assume that < 5 < 5i A 5 3 . Then we have 7(2/) • D y ip s (x, y)/5 > —e. Since v 
is a viscosity subsolution of (12. lip , we get G (y, D y ijj(x,y)/S) < 0. Now, as in the previous 
case, we obtain 

> G (x, Dcf>{x)) - oo G (C 2 5) - oo G (C 3 5). 

Consequently, if < 6 < 5± A 5 2 A £3, then we have G(x, p) < e. That is, in both cases, 
inequality (127171) holds if < 5 < <5i A 5 2 A 5 3 . 

Now, we assume in addition that \e n ■ x\ < 5 2 and show that if 5 > is sufficiently small, 
then 

(2.18) l(x)-p<e for p G D + v s (x). 

We fix any p G D + v(x) and choose a function G C 1 (B r ) so that v s — (f> attains a maximum 
at x and D(p(x) = p. For sufficiently small t > 0, we have ?/ — £7(2) G 5 r and hence 

v\x - tj(x)) > v(y) - -ip{x - tj(x), y). 
Thus, for sufficiently small t > 0, we have 

4>{x) — <f)(x — tj(x)) < v 5 (x) — v s (x — £7(2)) < — - (i[>(x, y) — ip{x — tj(x), y)) , 
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which readily yields 

7(2) ■ D<t>(x) < -j{x) ■ -D x ip{x,y). 



Noting that e n ■ y < and \e n ■ x\ < 5 2 , we observe by (12.15P that 

j(x) ■ D y i/;(x,y) < -e n -j(x) e n -x < C 5 5 2 . 
Using these observations together with (I2.14p . we obtain 

l(x) ■ v < ~ ■ ^D x tp(x, y) 

<j{x) ■ ~D y ><j>(x,y) + ^p-\D x ^(x,y) + D y ^(x,y)\ < (C 5 + C 3 C 5 )5. 

Choosing a constant 64 > so that C§{1 + 03)64 < e, we find that if < 8 < 64, then (12.18P 
holds. 

Finally, we may choose a constant £5 > so that \v(x)— v s (x) \ < e for all x G B r / 2 PI {e* < 
0} and < 5 < 65. Fixing a constant < 5 < mini<j<5 5{ and setting w = v s , we see that w 
satisfies the required properties with S 2 in place of 5. □ 

Proof of Theorem \2.1[ It is enough to show that for each t G I there is a function p T £ 
L°°(J r , R n ) for some constant 5 = 5 T > 0, where I T := I n [r - S, r + 6], such that (12~T1L 
(FJ2D and O hold with J T in place of J. 

We fix any r £ /. If r^(r) £ f2, then there is a constant 5 > such that for t £ I T := 
7 fl [r — <5, r + 5], we have rj(t) £ fi. Lemma 12.21 then guarantees that there is a function 
p T £ L°°(I T , ~R n ) such that fl2.1l) - fl2.3l) hold with I T and p T in place of 7 and p, respectively. 

We may therefore assume that r/(r) £ dQ. By making a C 1 change of variables, we may 
assume that r/(r) = and that there is a constant r > such that 7? r fl Q C {e* < 0} and 
B r n {e; < 0} C a 

We choose a constant 5 > so that r)(t) £ 7> r /2 for all t £ 7 T := [r — 5, r + <5] fl 7. We 
choose a constant L > so that {i7(x, •) < 0} C Bl for x £ fl. An immediate consequence 
is that u is Lipschitz continuous on Q with L as its Lipschitz constant. 

We may assume that 7 and g are defined on Q as continuous functions. We fix any e > 
and choose functions 7 e £ C°°(B r , W n ) and # £ £ C°°(B r , R) so that 

|7 e (x) — 7(x)| < — and \g e (x) — 9( x )\ — £ f° r a ll x £ B r n {e* < 0}. 

We may assume furthermore by replacing r > by a smaller one if needed that 7 e (a?) ■ e n > 
for all x £ B r . 

We remark here that a is a subsolution of 

i7(x, Du(z)) < in B r n {e^ < 0}, 
D le u(x) = g s (x) + 2e on fi r n {e* = 0}. 

To see this, let x E B r n {e* = 0} and p £ 7)^ n r ea « <0 iu(x). We have two cases, either 
H(x, p) < or 7(2;) • p < g(x). If H(x, p) < 0, then we are done. Otherwise, applying 
Lemma 12.3} with B r replaced by a small ball centered at x, we find that 

TeOO ■ p < g( x ) + £ < fi'e^) + 2£: - 
That is, m is a subsolution of (I2.19p . 



(2.19) 
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Thanks to Lemma 12 A\ there is a function i/j £ £ C°°(B r ) such that 

(2.20) 7 e (x) • Drj} e {x) = g £ (x) + 3e for x £ £ r . 

We have used here the fact that 7 e and g £ can be extended to C°° functions on W 1 so that 
inf 3;eM n7 e (x) • e n > and sup M „(|sf £ | + 1^]) < oo. 

We may assume by extending H to B r D {e* > 0} in an appropriate manner that H is 
defined and continuous at least on B r x M n and satisfies (A2), with B r in place of Q. We 
set v £ := u - ip £ on £? r n {e* < 0} and G £ (x, p) = H(x, p + Dip £ (x)) for (x,p) £ (B r x R n . 
It is obvious that v £ is a subsolution of G s (x, Dv e (x)) = in B r n {e* < 0}. Moreover, it is 
easily checked that w e is a subsolution of 

f G^z, Dv e (a;)) < in B r n {e* < 0}, 
\ D ls v £ (x) = —e on 5 r n {e* = 0}. 

According to Lemma [2.5[ there exists a function e £ C(B r /2 D {e* < p e }), with p e > 0, 
such that 

|i> s (x) - e (x)| < e for x £ B r n {e* < 0}, 
and e is both a subsolution of 

(2.21) G £ (x, D(f> £ (x)) = e in B r/2 n R < pj, 
and of 

(2.22) 7e (x) ■ £>0 £ (x) = £ on B r/2 n{\e* n \ < p £ }. 

Now, according to Lemma I2.2[ there is a function q £ £ L°°(I T , W 1 ) such that ? e (i) £ 
dc<f> e (v(t)) an d (d0 £ o r// d£)(i) = q £ {t) ■ fj(t) for a.e. t £ J T , The last equality can be stated 
as 

(2.23) Mv(t)) - Mv(r)) = J qe(s) ■ fts) ds for i £ J T . 
Setting 

I T . d = {tEl T : e n • r](t) = 0}. 
and noting that rj(t) £ 5 r/2 fl {e* n < 0} for t £ J r , from (127211 and ([2722]) we get 



(2.24) G e (r](t), q £ (t)) < e for a.e. t £ J T , 

(2.25) %(v(t)) ■ q e (t) < e for a.e. t £ J T , a . 

We set p £ (t) = q £ (t) + Dip £ (r)(t)) for t £ I T . Then (TJZSD, dCTD and (12351) read 

(2.26) ^(0) - &Mt)) = y (p e (5)-D^(5))-)7(s)da for t £ J T . 

(2.27) Pe{t)) < e for a.e. t £ 7 T , 

(2.28) 7 £ (77(t)) ■ (p £ (t) - D^ £ (rj(t)) )<e for a.e. t £ I T>9 . 



Combining this (12725]) and (1272D]) . we get 

7 e fa(*)) ■ p e (*) < + 4e for a.e. t £ J T>a . 
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By (gjH , we have 

(0 £ + ^ e )(t) = (0 e + V e )(r) + J Ps{s) ■ rj{s) ds for t G 7 T . 

We note here that <p £ + ip E — > u uniformly on B r fl {e* < 0} as e — > 0. From (I2.27p . we find 
that 

\Pe{t)\ < L for a.e. t G I T . 

Hence, there is a sequence Sj — > 0+ such that the sequence {p £j }j € ^ converges to some 
function p on I T weakly-star in L°°(J r , M"). It is a standard observation that there is a 
sequence {iij}jeN C L°°(I T , M. n ) such that VTj(t) converges to for a e. t G J r and for each 
j, the function iij is a convex combination of {p £k }k>j- Thus, sending j — > oo, we find that 

u {v{t)) ~ u (v( T )) = J p(s) ■ r](s) ds for t G I T , 

H(r}(t), p(t)) < for a.e. t G J r , 
7(?7(t)) • < ^(r/(t)) for a.e. t G 7 T , 9 . 

The proof is now complete. □ 



3. Proof of Theorem 11.31 

We start by recalling some results established in [15] and needed in this section. 

We write J = [0, oo) for simplicity of notation. The Skorokhod problem associated with 
(fi, 7) is to find a pair (77, 1) G Lip (J, R n ) x L°°( J, R), for given igO and v G J, M n ), 
such that 

?7(0) = x, rj{s) G H for all s G J, 
Z(s) > for a.e. s G J, 

(3.1) S 

Z(s) = for a.e. s G J such that r?(s) G fl, 
fj(s) + /(s)7(r/(s)) = v(s) for a.e. s G J. 

According to [TBI Theorem 4.2], problem (13.1 p has a solution. For 1 G fi, we denote by 
SP(x) the set of all triples 

(77, ^, G Lip (J, R n ) x L°°(J,R ?t ) x L°°(J, E) 

which satisfy (13. ip . 

Let L denote the Lagrangian of H. That is, L(x, ^) = sup peRn {^ ■ p — L(x, p)} for 
(1, ()gJ1x M n . Thanks to [13 Theorem 5.1], we know that if u is a solution of (ll.ip -f TO]) . 
then 

u(x, t) = ini {J o i L (ri(s), -v(s)) + g(ji(s))l(s)) ds 

+ u (v(t)) ■ (V,v,l) G SP(x)) for (x,t) G x (0, 00). 
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The dynamic programming principle yields for (x,t) G Cl x (0, oo) and < r < t, 
u(x, t) = ' mi {J Q i L (v(s), -v(s)) + g(rj(s))l(s)) ds 
+ u( V (r),t-T) : (r),v,l) G SP(x)). 



We assume throughout this section that c = 0, i.e., problem (11. 5p has a solution. In what 
follows, u = u(x,t) will denote the unique solution of ( ll.ip -( Tl~3"]) . Due to [151 Lemma 6.5], 
if we set 

Uoo(x) = liminf u(x,t) for x G Cl, 

t— >oo 

then G Lip and solution of ( II. 5p . Moreover, the proof of [151 Lemma 6.5] 

shows that the convergence 

(3.2) ^oo(^) = lim inf{w(y,t) : t > r}. 

r—too 

is uniform for x G Cl. 

Due to [151 Theorem 7.3], if is a solution of (ll.5p . then for each x G f2 there exists a 
triple (?7, v, I) G SP(x) such that 

</>{x) - </>(rj{t)) = [ (L( V (s),-v(s)) + l(s)g( V (s)))ds for t > 0. 

According to [131 Lemma 4.4] or [HI Lemma 5.2], if, in addition to (Al) and (A2), (A5) + 
(resp., (A5)_) is satisfied, then there is a constant 5± > such that for any 5 G [0, Si] and 
(x t £)eS, 

L(x, (1 + 6)0 < (1 + $)L(z, + 5^(5), 
' (resp., L(x, (1 - 6)0 < (1 - <J)L(x, £) + ). 

(The definition of 5* is given in Section 1 as well as that of Q.) 
Proof of Theorem \1.3[ It is enough to show that 
(3.4) lim (u(x, t) — Uoo(x)) + = for all x G Cl 

t—>oo 

and the convergence is uniform for x G Cl. In fact, it is immediate to see from this uniform 
convergence and (I3.2p that u(x,t) — > Uoo(x) uniformly for x G Cl as t — )■ oo. 
Fix any z G Cl. Let (r), v, 1) G SP(z) be such that for all t > 0, 

Uoo(z) -«oo {v(t)) = / ( L (v( s ), -v( s )) + K s )9{v( s ))) ds 



Due to Theorem 12.11 there exists a function q G L°°(J, M. n ) such that 

{-^m 00 (?7(s)) = g(s) • f](s) for a.e. s G J, 
H(rj(s), q(s)) < for a.e. s G J, 
7(77) • g(s) < ^(77(5)) for a.e. s G J a , 

where Jq := {s G J : ?](s) G 



14 HITOSHI ISHII 

We now show that 

(3.5) H(rj(s), q(s)) = for a.e. s G J, 

(3.6) l(v(s)) ■ q(s) = g(r](s)) for a.e. s G Jq, 

(3.7) — q(s) ■ v(s) = H(rj(s), q(s)) + L(r](s), —v(s)) for a.e. s G J. 
We remark here that equality (13 .7p is equivalent to saying that 

—v(s) G D2 H{r)(s), q(s)) for a.e. s G J, 

or 

g(s) G D^L^rj^s), —v(s)) for a.e. s G J, 

where D^fix, y) stands for the sub differential with respective to the second variable y of 
the function / on a subset of lR n x M n at (x, y). 
Fix any t > 0. Noting that 

Woo (??(*))- «oo (?7(0)) = / ?(s) ■ 7)(s) ds, 

«/ 

we compute that 

f (L{ V {s), -v(a)) + l(s)g(ri(a))) ds 
Jo 

= u^z) - Moo(?7(t)) = - / q{s) ■ rj{s) ds 

Jo 

= q(s) ■ (l(s)n/(rj(s)) -v(s))ds 
Jo 

< [ (H( V (s),q(s)) + L( V (s),-v(s)) + l(s)g( V (s)))ds 
Jo 

< [ (L( V (s), -v(s)) + l(s)g(rj(s)))ds. 
Jo 

This series of inequalities ensures that (I3.5p - fl3.7p hold. 

We fix any e > 0, and prove that there is a constant r > and for each i£fla number 
cr(x) G [0, r] for which 

(3.8) Uoo(x) + e > u(x, cr(x)). 

In view of the definition of u^,, for each iGfi there is a constant t(x) > such that 

Uco(x) + e > u(x, t(x)). 

By continuity, for each fixed x G f2, we can choose a constant r{x) > so that 

Uoo{y) + e> u(y, t(x)) for y G ft n S r(a; )(x), 

where B p (x) := G R n : |y — x| < p}. By compactness, there is a finite sequence Xi, 
i = 1, 2, JV, such that 

fiC |J B r ( Xi) (xi), 

l<i<N 
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That is, for any y G Q there exists Xi, with 1 < i < N, such that y G B r ( Xi )(xi), which 



we find that for each igfi there is a constant cr(x) G [0, r] such that (13. 8p holds. 

The rest of the proof is similar to the proof of [13], Theorem 4.3], but for completeness we 
give here the details. 

In what follows we fix r > and a(x) G [0, r], with x G Q, so that (13.81) holds. Also, we 
fix a constant 5i > and a modulus wi so that (I3.3P holds. 

We divide our argument into two cases according to which hypothesis is valid, (A5)+ 
or (A5)_. We first argue under hypothesis (A5) + . Choose a constant T > r so that 
r/(T - r) < <Ji. Fix any t > T, and set 9 = a{rj{t)) G [0, r]. We set 5 = 8/(t - 9) and note 
that S < r/(t — r) < 8\. We define functions rjs, v$, Is on J by 



and note that (rjs, Vg, lg) G SP(^). By ( 13. 5 p and (13. 7p . we know that (r](s), q(s)) G Q and 
(rj(s), —v(s)) G S for a.e. s G J. Therefore, by (j3.3J) . we get 

^(^(s), < (1 + S)L(r)((l + S)s), -v(l + S)s)) + (Jo;i(<J) for a.e. s G J. 

Integrating this over (0, t — 9), making a change of variables in the integral and noting that 
(l + 5)(t-9) =t, we get 



implies 



Uoo(y) + £> u(y, t(xi)). 



Thus, setting 



t = max t(xi), 

Ki<N 



T)s(s) =T)((1 + 5)S), 

v 5 (s)=(l + 5)v((l + 5)s), 
l 5 (s)=(l + S)l((l + 6)s), 




as well as 




Moreover, 




< / (L(T] S {s),v s (s)) + l s (s)g(T] S (s)))ds + u{r] S (t-9),0) 



< [ (L( v (s), -v(s)) + l(s)g( V (s))) ds + 9^(5) + u( Vs (t - 9), 9) 



Jo 



= u^z) - Uoo(77(t)) + tui(S) + u(r)(t), cr(r](t))) 

< Uoo^z) - U^it)) + TUi(S) + U 00 (7?(t)) + £ 

= u oc (z) + rwi(5) + e. 
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Thus, recalling that 5 < r/(t — r), we get 



(3.9) 



U(z, t) < U^z) + T<jJ\ 



( 



t ~ T 



T 



) 



+ e. 



Next, we consider the case where (A5)_ is satisfied. We choose T > r as before, and fix 
t>T. Set 9 = a(r)(t-r)) G [0, r] and 5 = (r-9)/(t-9). Observe that (1-<S) (t-0) = t-r 
and 5 < r/(t - r) < Si. 

We set t) S (s) = rj((l - S)s), v 5 (s) = (1 - S)v((l - S)s) and l s (s) = (1 - S)l((l - S)s) for 
s G J and observe that (7/5, t^, Z^) G SP(z). As before, thanks to (13.31) . we get 

L(r) S (s), -v s (s)) < (1 - S)L(r)((l - 6)s), -v(l - S)s)) + Soj^S) for a.e. s G J. 

Hence, we obtain 




and 




Moreover, we get 



u 




< [ T (L( V (s), -v(s)) + l(s)g( V (s))) ds + (r- 9)^(5) + u(r,(t - r), 9) 



= - Uoo(r)(t - r)) + (r - 9)ui(8) + u(r)(t - r), a(r)(t - r))) 

< Uoo(z) - Woo(77(t - r)) + (r - 6>)^i(<5) + w 0O (?7(t - r)) + e 

= Moo(2) + TWi((5) + £. 



Thus, we get 




From the above inequality and (13. 9 p we see that if t > T, then 




for all i6ll, 



which shows that (I3.4p is valid. The proof is now complete. 



□ 
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4. Remark on asymptotic solutions 

We continue to assume that the critical value c is zero. Let u denote the unique solution 
of (fL~T]) - (rO)) . We set 

Uq (x) = sup \jp(x) : ip is a subsolution of (II. 5p . ip < u on fl} for x G fl, 
u d( x ) = i^{d(x, y) + u o(y) '■ for x G 0, 

w~(x, t) = inf {u(x, t + r) : r > 0} for (x, t) G fl x [0, oo), 
M o°( a; ) = inf{0(aj) : is a solution of (II. 5p . ^ > Mg on fl} for x G fl, 

= inf{<i(x, y) + : y G ^4} for igH, 

^00(2) = sup{u~(x,i) : t > 0} for x G fl, 
where <i denotes the function on O x fl given by 

d(x,y) = sup{-?/>(£) — ip{y) : ^ is a subsolution of (II. 5p }. 

and A denotes the Aubry (or Aubry-Mather) set associated with (11.51) . See [T3] for the 
definition of the Aubry set associated with (jl .5j) . 
Note here that the proof of Theorem 11.31 shows that 

lim u(x, t) = u^x) for iGO. 

t— >oo 

The following proposition gives two other formulas for Uoo, which are valid without one of 
assumptions (A5) + or (A5)_. 

Proposition 4.1. For every x G fl we have 

(4.1) Uq (x) = Uj(x) = u~(x, 0), 

(4.2) =uf(x) =u 0O (x). 

Proof. Let ip be a subsolution of (II. 5p satisfying if; < u on fl. Then we have 

ip(x) < tp(y) + d(x, y) < u (y) + d(x, y) for x, y G fl. 

Hence, we see that Uq < on fl. Next, since < u on fl, observing by [TSJ Theorem 
2.7] that is a subsolution of (II. 5p . we find that < Uq on fl. Thus we have Uq = 
on fl. Now, since Uq < u on fl and Uq(x), as a function of (x, t), is a subsolution of 
(ll.ip - (ll.3p . by comparison (see for instance [151 Theorem 3.4]) we find that Uq (2) < u(x,t) 
for (x, t) G fl x [0, 00). From this it follows that Mq < w~(-, 0) on fl. On the other hand, 
u~(x, t) is a solution of (II. ip and (II. 2p and nondecreasing in t, and consequently w~(-, 0) is a 
subsolution of (II. 5p . Moreover, we have u~(-, 0) < u on fl, and conclude that u~(-, 0) < Uq 
on fl. We thus find that = = u~(-, 0) on fl. 

Next let be a solution of (II. 5p satisfying <fi > Uq = on fl. By [T5"} Theorem 6.8], we 
have 

(f)(x) = inf {4>{y) + d(x, y) : y G ^4} for a; G fl, 

and hence 

0(x) > inf{-u^(?/) + d(x,y) : y G ^4} for x G fl. 
Accordingly, we get > on fl. Next, if we set <f)(x) = u^(y) + d(x,y) for any fixed 
y G A, then is a solution of (I1.5P and 0(x) > u^(x) = Uq(x) for x G fl. Hence we get 
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< on Q. Thus we have = on Q. Now we note that > u~(-, 0) on Q. 
Since Mq°(x) and t), as functions of (x,t), are solutions of (II. ip and ( II .2p . we see by 

comparison that > u~(x,t) for (x,t) £ fi x (0, oo), from which follows that > 

on fi. Similarly, we have Uq(x) < u~(x,t) for (x,t) e x [0, oo). Hence we get Uq < Uoo 
on Q. Since is a solution of (II. 5p . we see that < on f2. We thus conclude that 
n d° = n o° = u oo on f2. □ 

The interpretation of the above proposition into the general case of c is straightforward, 
and indeed, we just need to replace the solution u(x,t) of (ll.ll) - (ll.3p and H(x,p), respec- 
tively, by u(x,t) := u(x, t) + ct and H(x,p) = H(x,p) — c in the above argument. The 
conclusion is as follows. We set 

d(x, y) = svp{if)(x) — if){y) ■ ip is a subsolution of (II .4[) } for x,y G Q, 
Uq(x) = sup \if){x) : ip is a subsolution of (11.41) . if) < u on f2} for x E fl, 
u~f(x) = inf{<i(x, y) + ito(y) : 2/ G H} for x G fi, 
u~(x,t) = inf{u(x, t + t) + c(t + r) : t > 0} for (x,t) E f2 x [0, oo), 
M o°( x ) = inf{0(x) : is a solution of ( II. 4p . <f> > on f2} for iGO, 
m^°(x) = inf{d(x,y) + -u^(y) : y E A} for igH, 
Woot^) — sup{w~(x,t) : £ > 0} for i G H, 

where A denotes the Aubry set associated with (II. 4p . Then the assertion of Theorem 11.31 
together with Proposition 14.11 is stated as 

lim (u(x, t) + ct) = Moo(x) = u°f(x) = u™(x) uniformly on £l. 

t— >oo 
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